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ABSTRACT 

The  application  of  computer  graphics  to  problem  solving  has 
increased  over  the  past  few  years.  The  representation  of  data  in 
the  form  of  line  drawings,  graphs,  charts,  diagrams  and  line  plots 
has  been  explored  extensively.  This  paper  addresses  itself  to  some 
new  techniques  used  to  solve  problems  associated  with  extending  the 
power  of  computer  graphics  to  include  black  and  white,  and  color 
shading.  In  particular  it  presents  a  new  method  for  converting  data 
describing  three-dimensional  objects  into  data  that  can  be  used  to 
generate  two-dimensional  halftone  images.  It  deals  with  some  problems 
that  arise  in  black  and  white,  and  color  shading. 
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INTRODUCTION 

The  past  few  years  have  seen  an  enormous  increase  in  the  use 
of  computer  graphics.  Nevertheless,  the  medium  is  still  very 
restricted  and  primitive. ^  Present  day  equipment  makes  it  im¬ 
possible  to  achieve  the  pictorial  realism  that  a  graphic  artist  can 
attain.  Coloring,  shading,  texture,  and  lighting  effects  are  not 
available  to  the  computer  graphics  user.  With  the  present  state  of 
computer  graphics  in  mind  it  is  meaningful  ta  ask  what  current 
technology  can  do  to  enhance  the  power  of  computer  graphics.  The 
aspects  we  would  like  to  control  may  include  intensity,  color,  and 
location  of  light  sources;  reflectance,  surface  texture,  and  coloring 
of  the  objects;  and  general  illumination  and  atmospheric  interference 
in  the  picture  field.  If  these  parameters  can  be  controlled  c’.en 
computer  graphics  will  offer  a  powerful  tool  for  generating  visual 
images . 

This  paper  will  address  itself  to  some  of  the  problems  that 
arise  in  trying  to  attain  the  above  goals.  In  particular  it  will 
deal  with  the  problem  of  converting  data  that  describes  objects  in 
three-dimensional  space  into  data  that  can  generate  a  two-dimensional 
picture  representation  of  those  objects.  This  problem  is  generally 
called  the  "Hidden  Line"  or  “Hidden  Surface’-  problem.  The  final 
section  of  this  paper  discusses  the  illumination,  coloring  and  shading 
of  picture  representations  of  three-dimensional  objects,  and  the 
display  file  structures  that  generate  raster  scan  images  on  a  display. 
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A  NEW  PHILOSOPHY  OF  HIDDEN  SURFACE  ALGORITHMS 

\ 

The  description  o£  the  philosophy  is  best  given  by  describing 

\ 

the  motivation  behind  it.  Suppose  I  examine  a  picture  of  a  table 
with  pencils  y>n  it.  I  quickly  determine  that  large  areas  on  top  of 
the  table  are  \open  and  therefore  have  little  information  content. 

I 

I  scan  over  these  areas  rearching  out  complex  features  such  as  a 

\ 

pencil.  1  dwell  on  a  complex  portion  until  I  assimilate  the  inf or- 

i 

\ 

mat ion  associated  with  it.  From  there  I  scan  to  other  areas  of  the 

\ 

picture  looking  for  additional  complexity.  In  scanning  the  picture 
in  this  way  I  seem  to  spend  little  or  no  time  on  simple  areas. 

Complex  areas  seem  to  present  themselves  to  me  as  subproblems  re¬ 
quiring  a  solution.  I  seem  to  reduce  these  problems  into  further 
subproblems  until  I  either  solve  the  subproblem  or  don't  care  any¬ 
more. 

New  algorithms  for  removing  hidden  surfaces  which  emulate  the 
above  process  will  new  be  discussed.  Consider  the  view  plane  as  a 
square  picture.  Either  its  contents  are  simple  enough  to  process 
with  some  decision  procedure  or  they  are  not  sufficiently  simple. 

If  they  are  not,  then  we  subdivide  the  square  into  four  subsquares 
and  ask  the  same  question  about  the  contents  of  the  first  subsquare 
as  was  asked  about  the  parent  square.  This  process  is  repeated 
recursively  until  one  of  two  conditions  holds  with  respect  to  a 
subsquare.  If  the  contents  of  the  square  are  simple  enough  to  pro¬ 
cess,  then  data  is  put  into  a  display  file.  If  the  square  is  as  small 
or  smaller  than  the  desired  resolution  of  the  picture,  then  put  a 
reference  to  the  surface  nearest  to  the  observer  into  the  display 


file. 
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The  decision  procedure  that  determines  if  subdivision  of  squares 
is  necessary  can  be  simple.  Suppose  a  picture  is  of  a  set  of  planar 
polygons.  We  will  generally  subdivide  a  square  unless  one  of  two 
conditions  holds.  The  projections  of  the  polygons  onto  the  view 
plane  do  not  intersect  with  the  square;  or  the  square  is  surrounded 
by  a  projected  polygon  which  is  in  front  of  other  extended  polygons 
within  the  square.  Figure  la  illustrates  what  a  view  plane  may  look 
like  if  subdivided  by  the  above  process. 


« 


3 


"SFg 


for  finding  locally  simple  geometric  phenomena  in  portions  of  the  view 

[3J 

plane.  Some  observers  characterize  the  algorithm  as  being  what  Floyd 
calls  "non-deterministic".  Another  point  of  view  sees  the  algorithm 
as  making  a  tree  of  goals.  As  a  goal  is  considered,  a  decision  is 
made  about  its  difficulty.  If  it  cannot  be  achieved  with  the  methods 
at  hand,  the  algorithm  generates  subgoals  (four).  The  first  subgoal 
is  now  considered.  This  process  is  repeated  recursively  until  either 
success  is  reported  at  some  subgoal  or  until  success  is  reported  by 
default  (In  our  case  when  the  resolution  of  the  picture  is  reached). 

When  success  is  reported,  the  next  subgoal  at  the  same  level  (the 
brother)  is  considered.  If  all  subgoals  of  a  given  goal  have  reported 
success,  then  the  goal  itself  reports  success.  This  order  of  examin¬ 
ing  goals  and  their  subgoals  is  called  a  "prefix"  ordering  of  the  tree. 
In  any  event  the  important  thing  is  that  a  difficult  problem  can 
successfully  be  divided  into  smaller,  easier  subproblems.  This  approach 
has  many  programming  and  data  structuring  advantages. 

Subdividing  the  picture  in  a  prefix  order  allows  the  computing 
associated  with  each  square  to  be  reduced  by  saving  information  about 
what  happened  in  the  is'ger  "parent"  squares.  It  is  useful  to  save 
information  invariant  under  the  operation  of  subdivision.  Such  infor¬ 
mation  can  be  called  "inherited".  Taking  advantage  of  inherited 
information  can  significantly  reduce  the  computation  associated  with 
small  squares. 

Let  us  consider  how  inherited  information  might  be  used  when  a 
square  and  a  polygon  are  disjoint.  In  this  case  the  fact  that  the 
polygon  and  square  are  disjoint  is  inherited  by  all  subsquares  of 
that  square,  i.e.,  the  subsquares  are  also  disjoint  with  the  polygon. 
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When  inherited  information  given  in  this  example  is  used,  it  is 
generally  true  that  the  number  of  pianar  polygons  processed  becomes 
smaller  as  the  squares  examined  get  smaller.  Using  this  fact  allows 
large  amounts  of  data  noc  relevant  to  the  local  problems  to  be  shelved. 
Saving  the  level  of  refinement  at  which  th<»  data  is  shelved  allows 
the  reconsideration  of  that  data  when  coming  up  out  of  the  sub¬ 
division  process.  Data  is  reintroduced  at  the  level  at  which  it 
was  shelved  so  chat  brother  squares  at  that  level  may  be  correctly 
processed. 

The  decision  procedure  that  determines  if  a  square  is  to  be 
subdivided  is  important.  If  the  procedure  is  relatively  simple, 
then  many  subsquares  may  be  processed,  if  the  procedure  is  complex, 
then  a  fewer  squares  may  be  processed  and  yet  computation  per  square 
may  be  high.  In  our  discussion  of  the  hidden  surface  algorithm 
three  decision  procedures  will  be  discussed.  The  first  will  be  dis¬ 
cussed  now.  The  last  two  will  be  introduced  under  the  heading 

"Variations  on  the  Theme".  Let  us  assume  that  the  input  to  the  algo¬ 
rithm  is  any  collection  of  planar  polygons  in  three-space.  Also 
assume  that  a  polygon  k  is  given  as  a  sequence 

Pki  "  ^ki*  ^ki*  Zki^  I  =  •••  n}  of  n  ordered  planar  points 

chat  form  a  directed  closed  path  in  three-space.  Let  ?  be  a  map  from 
three-space  onto  the  view  plane  P  such  that  (P^)  o  =  (P'^),  for 

all  i.  Let  d^(ufv,w)  be  equal  tc  the  distance  from  the  point  (u,v,w) 

on  the  view  plane  to  the  point  (x,v,z)  on  the  plane  of  polygon  k 
such  that  ( x ,y , z )  o  «  (u,v,w),  (see  Figure  2).  We  can  now  describe 
a  compact  decision  procedure  that  will  remove  hidden  surfaces  from 
the  representation  on  P. 
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Figure  2 

There  are  three  basic  relationships  that  have  to  be  established 
between  each  polygon  and  the  square  being  processed. 

1. )  The  square  is  wholly  inside  the  projected  polygon. 

2. )  The  square  and  the  projected  polygon  intersect,  or 

3. )  The  square  is  wholly  outside  the  projected  polygon 

(see  Figures  3a,  3b,  and  3c).  Note  that  condition  1  and  2  may  not  be 
mutually  exclusive  (see  Figure  3d). 


Figure  3a 


Figure  3b 


Figure  3c 


Figure  3d 

To  determine  which  of  these  relationships  exists,  tests  are  made  on 
the  vertices  of  the  polygon  to  determine  if  any  are  in  the  square. 

If  any  vertex  of  uhc  polygon  is  in  the  square,  then  condition  2  is 
true.  The  edges  that  comprise  each  polygon  are  then  individually 
checked  to  see  if  any  intersect  the  square.  This  is  done  by  seeing 
if  either  of  the  segments  that  are  the  diagonals  of  the  square  inter¬ 
sect  the  given  edge.  If  any  edges  lie  within  the  square  then  although 
condition  1  might  be  true  we  will  assume  condition  2  is  true,  e.g. 
Figure  3d.  If  no  vertices  or  edges  are  within  the  square,  then  one 
corner  (w^ ,  u  ^ ,  v^,)  of  the  square  is  checked  to  see  if  it  is  in  the 
interior  of  the  polygon.  This  is  done  by  letting  R  be  any  ray  in 
the  view  plane  P  eminating  from  (w^ ,  v^).  Now  each  edge  of  the 

polygon  is  checked  against  R  to  see  if  it  crosses  R.  Also  the 
direction  in  which  edges  cross  is  recorded.  If  the  number  of  positive 
crossings  equals  the  number  of  negative  crossings,  then  the  square 
is  on  the  exterior  of  the  polygon,  (condition  3)  otherwise,  it  is 
wholly  inside  (condition  1). 

Once  the  relationships  between  the  square  and  the  polygons  have 
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been  determined,  subdivision  of  the  square  will  occur  unless  one  of 
the  following  conditions  is  satisfied.  Is  there  a  polygon  satisfying 
condition  1  that  hides  all  other  polygons?  More  precisely,  does  there 
exist  a  polygon  m  satisfying  condition  1  such  that  d^u^ ,  v^,  w^)  <=> 
min  !d^(Uj,  v  ^ ,  w^)  |  for  all  i  4  m  such  that  polygon  i  satisfies 
condition  1  or  2)  for  j“l,2,3,4  where  (u^ ,  v j ,  w^)  are  the  corners 
of  the  square?  If  such  a  polygon  exists,  then  subdivision  does  not 
occur.  The  other  condition,  where  subdivision  does  not  occur,  is 
satisfied  provided  all  polygons  have  condition  3  with  the  square, 
i.e.,  the  square  "sees"  nothing. 

Fortunately,  in  practice,  we  are  able  to  simplify  the  tests  for 
the  relationships  between  polygons  and  squares.  Let  the  view  plane  P 
be  the  X,Y  plane  and  the  projection  be  an  orthogonal  projection  onto 
that  plane.  This  assumption  is  not  restrictive  if  the  polygons  are 
put  through  appropriate  translation,  rotation,  clipping,  and  perspec¬ 
tive  transformations  before  projection.  If  the  above  special  case  is 
assumed,  then  P'^  «  (X^»  Y^»  0)  and  d^(x,y,0)  =  Ax  +  By  +  C  where 
Z  «  Ax  +  By  +  C  is  the  transformed  plane  of  the  polygon  in  question. 
Also  if  che  ray  used  in  checking  for  condition  1  is  assumed  to  have 

i 

zero  slope,  then  computation  is  simplified. 

The  decision  procedure  just  described  will  produce  resolution 
size  squares  along  visible  edges  and  intersection  of  the  polygons. 

If  these  are  directly  displayed  then  a  line  drawing  of  the  object 
with  hidden  surfaces  removed  will  result.  Sec  Figure  5a. 

DATA  STRUCTURE 

The  preceding  discussion  has  mentioned  nothing  about  the  data 
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structures  that  are  used  in  implementing  the  algorithm.  We  assume 
that  the  input  to  the  algorithm  is  restricted  to  be  a  set  of  arbitrary 
planar  polygons  in  three-space. 

Folygons  can  be  input  in  a  variety  ot  ways.  They  can  be  con¬ 
sidered  to  be  a  sequence  of  points  (x^,  y^,  z^)  in  three-space  that 
form  a  closed  path.  They  can  be  considered  to  be  an  initial  point 
(Xo,Yo,Zo)  followed  by  increments  (AXi,AYi,AZi)  from  the  previous 
point  to  form  a  closed  path.  A  third  way  to  specify  the  polygons 
given  to  the  algorithm  is  to  give  the  x  and  y  coordinates  of  the  points 
defining  the  polygons  plus  the  equations  of  the  planes  of  the  poly¬ 
gons  in  the  form  Ax+By+Cz+D=0.  Any  of  these  input  schemes 
or  other  more  elaborate  schemes  ar°  eful  depending  on  the  applica¬ 
tion. 

Along  with  the  points  that  make  up  the  polygons  the  number  and 
order  of  points  in  each  polygon  is  important  in  the  input.  Other 
data  relevant  to  the  polygons  are  an  array  of  pointers  making  the 
set  of  input  polygons  into  a  list.  This  list  structure  is  important 
in  dealing  with  the  inherited  information  discussed  earlier. 

Another  essential  data  structure  is  that  which  is  output  during 
execution  of  the  algorithm.  I  call  this  the  display  file.  The 
nature  of  the  display  file  is  determined  by  the  decision  procedure 
used  to  decide  if  subdivision  of  a  square  is  necessary.  If  the 
decision  procedure  is  the  one  described  earlier,  then  the  display 
file  consists  of  the  points  (x,y)  on  the  view  plane  that  are  either 
on  visible  boundaries  of  polygons  or  on  visible  intersections  ot  poly¬ 
gons.  Information  associated  with  these  points  in  the  display  file 
depends  on  the  type  of  picture  and  shading  to  be  produced.  The 
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choice  of  a  particular  decision  procedure  is  influenced  by  the  cap¬ 
ability  of  the  display  processor.  Let  us  now  explore  these  data 
structures  in  the  context  of  the  algorithm. 

The  list  structure  that  we  impose  on  the  set  of  input  polygons 
facilitates  the  exploitation  of  the  inherited  properties  of  the  squares 
For  instance,  the  relationship  between  a  given  square  and  polygon 
can  be  one  of  three  types.  The  square  is  wholly  contained  within  the 
polygon.  The  square  can  contain  an  edge  or  vertex  of  the  polygon. 

Or  the  square  and  polygon  can  be  disjoint.  The  first  and  third  of 
these  conditions  are  inherited  by  all  subsquares  of  a  square.  Suppose 
we  treat  the  set  of  polygons  as  a  list  broken  into  three  parts.  The 
first  part  is  all  those  polygons  satsifying  condition  1,  the  second 
part  those  satisfying  condition  2,  and  the  third  those  satisfying 
condition  3.  Make  the  pointer  to  the  first  of  the  list  of  polygons 
point  to  the  head  of  part  1.  All  polygons  in  part  1  surround  any 
subsquare  and  therefore  need  not  be  checked  for  this  condition.  If 
a  polygon  in  part  2  is  found,  upon  checking,  to  surround  the  current 
subsquare,  then  this  polygon  can  be  inserted  on  the  tail  of  part  1 
for  use  in  the  next  level  of  recursion.  If  any  polygon  in  part  2  is 
found  to  be  disjoint  with  the  current  subsquare,  then  this  polygon 
can  be  inserted  at  the  head  of  part  3  for  use  in  the  next  level  of 
recursion.  Polygons  in  part  3  need  not  be  examined  at  all.  Conditions 

1  and  3  are  inherited  by  all  subsquares  of  a  given  square.  Condition 

2  may  not  be.  For  this  reason  each  polygon  satisfying  condition  2 
must  be  checked  with  respect  to  each  subsquare  to  see  which  of  the 
three  conditions  holds.  If  we  keep  pointers  to  the  end  of  pait  1  and 
to  the  beginning  of  part  3  for  each  level  in  the  recursion,  then 
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given  any  level  we  can  determine  what  relationships  the  polygons  have 
with  the  current  square  at  that  level.  See  Figure  4  for  an  example  of 
a  recursion  and  the  list  associated  with  it. 

The  lisr  described  above  nioelv  structures  some  of  the  inherited 
information.  Other  information  that  is  inherited  by  the  squares  is  not 
easily  handled  by  the  list.  An  example  of  this  occurs  when  a  polygon 
has  exactly  one  edge  that  intersects  the  square.  Note  that  if  this  is 
the  case  then  only  one  edge  n*red  lie  checked  for  intersection  with  auv 
subsquares.  This  type  of  inherited  information  can  be  saved  by  tagging 
each  polygon  with  the  level  at  which  the  condition  was  first  discovered 
plus  the  number  of  the  edge  that  crosses  the  square.  Other  inherited 
information  can  re  utilized  when  a  polygon  surrounding  the  current 
square  is  m  front  of  ocher  polygons.  The  polygons  that  are  hidden  :n 
thi.'.  wav  need  not  be  examined  m  anv  subsquares.  These  polygons  are 
flagged  in  a  wav  simiar  to  the  one’  above.  Bv  saving  more  information 
with  each  pvrly^on,  time  ..nuia  :c.no  Oivahlv  be  saved  but  scorage  coses  :»a  / 
he  high.  Foe  this  reason  additional  information  with  each  polygon  h...- 
not  been  saved  but  instead  has  been  recomputed  when  needed. 

VARIATIONS  ON  THE  THEME 

It  is  pertinent  at  this  time  to  explore  whar  might  be  done  to 
reduce  the  number  .f  o  iput  squares.  this  '^estiou  is  related  to  the 
dec.'si  .  ir...  .«.>  iuco  if  a  square  is  too  complicated  to  hendie 

and  the  efore  must  he  subdivided. 

One  approach  taken  to  out  down  the  number  of  output  squares  is 
to  t*  iininate  the  sublivision  ot  so, wares  whenever  at  most  one  line  of  a 
poivgon  ot  rutoi'-c  :  :  >r.  .  •  ;  o .  n>r..-n.-  :•  taint-."  in  the  square. 

It  t  i  dec  i a i  n  p  . c cd  ic  :s  used,  then  an  example  of  the  resulting 
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mosaic  of  squares  i§  given  in  Figura  lb.  We  can  aaa  from  comparing 
Figure  la  and  Figura  lb  chat  ehla  technique  reduces  the  number  of 
squares  that  need  be  examined  in  the  algorithm.  Since  the  additional 
logic  required  in  the  decision  procedure  Is  not  excessive,  the  adoption 
of  this  procedure  may  result  in  faster  execution. 

Another  approach  that  can  be  used  to  Implement  the  general 
philosophy  of  the  hidden  surface  algorithm  dictates  that  squares  may 
not  be  the  most  desirable  geometric  entity  to  subdivide.  This  approach 
might  suggest  that  since  scan  lines  are  th*  ultimate  output,  scan 
lines  should  be  the  construct  to  be  subdivided.  Although  there  are 
no  conceptual  advantages  to  this  method,  data  structuring  and  memory 
management  schemes  can  be  invoked  that  may  produce  savings, 

The  basic  strategy  of  this  approach  assumes,  as  in  the  previous 
cases,  that  a  collection  of  planar  polygons  are  input  to  the  algorithm. 
If  a  list  is  associated  with  the  array  of  points  of  the  polygons, 
then  this  Hot  can  reflect  the  order  of  the  points  such  that  the  y 
coordinate  of  the  points  decreases  as  the  list  is  followed.  This 
implicit  sorting  of  the  points  allows  the  edges  of  the  polygons  to 
be  entered  and  deleted  from  a  "current  edge"  list  as  they  are  germane 
to  the  computation  of  successive  scan  lines.  An  edge  enters  the  list 
when  the  y  coordinate  of  the  scan  line  matches  the  greater  of  the  y 
coordinates  of  the  edge.  The  edge  is  deleted  when  the  other  y  co¬ 
ordinate  is  matched  by  tho  y  coordinate  of  the  scan  line.  When  an 
edge  is  Introduced  Into  the  list  several  facts  are  stored  with  It. 

The  polygon  to  wnlch  tho  edge  belongs  Is  stored.  The  Initial  x 
coordinate  of  the  edge  alone  with  the  change  in  x  with  respect  to  v 
is  stored. 
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Under  Chit  Approach  the  strategy  for  protasis  mg  >  given  si<»n 
lint  coincides  with  the  strategy  for  the  entire  picture  in  the  pre¬ 
viously  described  schemes.  The  scan  line  is  renusiv*  )>  divided  in 
half  If  lCs  contents  are  too  complicated  to  process..  thts  technique* 
of  implementation  allows  the  "inherited"  information  to  be  utilized 
to  Its  full  extent  and  also  allows  f^r  a  much  simpler  -  omputation  on 
the  relationship  between  a  segment  of  a  scan  line  and  a  polygon  Thin 
method  hss  the  disadvantage,  however,  that  it  must  i.hiougb  the 
subdivision  process  for  each  scan  line  that  inters*-. ts  some  polygon 

Up  until  now  we  have  discussed  three  variations  lor  the  Implemen¬ 
tation  of  the  hidden  surface  algorithm.  The  strategy  that  minimizes 
time  in  the  context  of  the  algorithm's  philosophy  om  only  be  ob¬ 
tained  by  examining  computation  trade-offs  within  die  algorithm. 

This  paper  will  not  dwell  on  these  problems  since  die  evidence  we 
have  collected  docs  not  conclusively  indicate  that  ••if  method  is 
superior  to  another. 

THE  DISPLAY  OP  PICTURES 

There  le  something  common  to  all  types  of  displ-v  (lies  the 
algorithms  may  output.  The  information  in  the  uihpUv  iile  represent* 
the  visible  geometric  aspects  of  the  picture.  Th.-  i.*„v  die  Hie  re¬ 
presents  the  visible  geometry  is  a  function  of  th«  d.-.  mi  on  procedure 
that  allows  the  subdivision  of  squares.  If  the  «mi. division  of  a 
square  continues  when  any  visible  boundaries  are  in  um  square,  then 
the  display  file  consists  of  the  points  along  the  '.mHo  boundaries 
and  lntarsectlon  of  the  polygons.  In  this  case  tin*  id spiav  tile  is 
a  set  of  points  (x,y).  If  line  representations  cm  die  picture  are 
desired,  then  the  action  to  be  taken  is  quite  snide .  Mi*-  set  <n  u.o 
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points  must  be  sorted  into  the  order  that  corresponds  to  the  way  the 
raster  sweeps  the  display,  i.e.,  if  the  raster  sweeps  left  to  right, 
top  to  bottom,  then  sort  the  points  x  ascending  within  y  descending. 

If  the  scan  proceeds  and  each  point  in  the  scan  i6  compared  with  the 
first  point  in  the  sorted  display  file  until  a  mntch  is  found,  then 
tnct  point  can  be  intensified.  The  scan  can  now  be  continued  until 
a  match  with  the  next  point  in  the  display  file  is  found.  This  pro¬ 
cess  of  matching  and  advancing  the  scan  and  display  file  is  continued 
until  the  entire  picture  ia  produced  (see  Figure  5a).  The  above 
scheme  is  basically  the  same  for  all  of  the  techniques  that  we  have 
developed  for  converting  the  geometry  of  a  picture  into  a  raster  scan 
image.  In  all  these  techniques  the  display  file  is  sorted  so  that 
its  elements  are  encountered  in  the  same  order  as  the  raster  sweeps 
the  screen.  If  the  geometry  consists  of  points  as  in  the  above  case, 
then  the  points  are  encountered  in  the  same  order  as  the  scan  sweeps 
those  points.  If  the  geometry  consists  of  line  segments  as  is  the 
case  if  the  second  decision  procedure  is  adopted,  then  line  segments 
are  ordered  so  they  are  encountered  sequentially  by  the  raster. 

To  build  a  picture  from  line  segments  the  approach  taken  is 
more  complicated.  Once  a  line  is  encountered  by  the  raster  it  is  used 
in  generating  the  picture  until  the  line  segment  is  exhausted  by  the 
scanning  process.  Memory  is  dedicated  for  storing  the  line  segments 
that  are  currently  pertinent  to  the  generation  of  the  display. 

When  these  line  segments  are  encountered  as  the  scan  sweeps  the  dis¬ 
play,  they  are  inserted  into  memory.  The  segments  are  then  generated 
from  memory  point  by  point  until  exhausted.  They  are  then  deleted. 
Since  the  algorithm  cannot  allow  line  segments  to  intersect,  it  is 
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seen  chat  Che  updating  of  the  segment  from  scan  line  to  scan  line  can 
never  alter  their  order  in  the  memory  for  current  lines.  For  this 
reason  the  memory  in  which  the  segments  are  stored  can  be  thought  of 
as  a  circular  queue.  In  conjunction  with  the  processing  of  segments, 
new  segments  are  introduced  into  the  queue  ss  they  are  encountered  by 
the  raster.  Information  that  is  required  with  each  line  segment 
varies  with  the  kind  of  shading  desired.  If  one  wants  to  display 
the  lines  themselves,  then  the  following  is  needed:  The  initial  point 

I 

of  each  segment  (x^,  y^) ,  the  inverse  of  the  slope  Ax/A y  and  the  last 
y  coordinate  of  the  segment  y^.  The  segment  is  introduced  into  the 
memory  based  on  x^  and  y^.  It  is  deleted  when  a  match  on  yL  occurs. 

The  intermediate  values  are  attained  by  updating  Xq  with  Ax/Ay.  This 
scheme  requires  no  searching  and  therefore  is  quite  efficient. 

If  halftone  shading  of  the  polygons  is  desired  with  tfie  first  kind 
of  display  file,  then  the  action  to  be  taken  is  simple.  When  the  poly¬ 
gons  are  passed  to  the  hidden  line  routine,  a  shading  function  is  com¬ 
puted  for  each  polygon.  This  function  is  in  terms  of  x  ar.d  y  and  yields 
a  brightness  level  for  that  polygon  at  a  point  (x,y).  In  the  process  of 
hidden  line  removal  each  display  file  entry  (x,y)  is  tagged  with  a 
pointer  to  the  polygon  seen  immediately  to  its  right.  If  there  is  no 
polygon  to  the  right  then  a  null  polygon  is  used.  With  this  display 
file  it  is  easy  to  produce  a  shaded  picture.  The  display  file  is  sorted 
x  ascending  within  y  descending.  As  each  point  is  encountered  by  the 
scan,  the  shading  function  associated  with  the  polygon  is  put  into  effect 
along  the  scan  line  until  the  next  point,  it.  encountered  by  the  scan  and 
its  shading  function  takes  effect.  This  method  allows  a  flexible  use  of 
the  halftone  display.  By  overlaying  three  shading  functions  correspon  l un 
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to  the  additive  primary  color  components  on  a  given  polygon  it  is  quite 

i 

easy  to  achieve  full  color  capabilities  in  the  shading  <^f  the  objects 

t 

displayed.  What  these  shading  t unctions  are  and  how  they  are  achieved 
will  be  the  next  topic  of  discussion. 

SHADING  AND  COLOR 

The  production  of  shaded  pictures  in  black  and  white  or  "natural" 
color  presents  some  very  unusual  problems.  The  variables  of  which  the 
worker  must  be  aware  in  the  consideration  of  a  model  include  the  follow¬ 
ing: 


a.  The  spectral  components  ol  the  simulated  or  fictional  source  light. 

b.  The  spectral  filtering  and  scattering  effects  of  the  simulated  or 
fictional  atmosphere  in  which  the  scene  resides. 

c.  The  surface  reflectance  qualities  of  the  simulated  or  fictional 
objects. 

d.  The  absorption  and  reflectance  properties  of  the  various  parts  of 
the  spectrum  by  the  color  of  the  object. 

e.  The  distance  and  angle  ot  the  polygons  with  respect  to  the  source 
light . 

f.  The  nonlinearities  in  the  circuitry  to  the  display  system. 

g.  The  spectral  components  ot  the  light  emission  of  the  display 
phosphor  as  a  function  ot  beam  current. 

h.  The  spectral  filtering  ot  the  color  separation  filters  used. 

i.  The  color  distortion  of  the  photographic  lens. 

j.  The  sensitivity  of  the  film  to  various  areas  of  the  spectrum. 

k.  The  reflectance  properties  of  the  dyes  used  in  the  film. 

In  lieu  of  building  a  mathematical  color  model  that  will  compensate 
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and  account  for  all  of  the  above  variables,  a  description  will  be  given 
of  color  and  shading  models  that  will  yield  acceptable  results.  These 
models  have  been  constructed  on  empirical  considerations  and  should  in 
no  way  be  regarded  as  models  for  colorimetry,  optics,  or  psychophysics. 

The  shading  models  and  color  models  that  have  been  used  will  be 
discussed  in  the  order  in  which  they  evolved. 

The  simplest  approach  to  black  and  white  shading  is  to  ignore  all 
aspects  of  lighting  except  the  angle  between  a  ray  from  the  light  source 
and  the  normal  to  the  polygon  under  consideration.  If  this  is  done  then 
the  shade  of  a  polygon  can  be  given  by  s  =  K|cos  ■  .■  j  +  M  here  K  and  M  ad¬ 
just  the  magnitude  of  the  numbers  going  to  the  display.  0  is  the  angle 
between  a  ray  from  the  source  and  the  normal  to  the  polygon.  This  r.’iading 
rule  produces  acceptable  real-looking  results  in  most  cases.  Its  draw¬ 
back  can  be  noticed  when  a  picture  of  two  overlapping  separated  parallel 
planes  is  made  and  the  edge  that  overlaps  cannot  be  detected. 

The  second  type  of  shading  model  considers  the  shading  of  a  point 
on  a  polygon  to  be  a  function  of  its  distance  from  the  light  source. 

The  function  can  be  given  by  s  =  L  +  M.  Here  r  is  the  distance 

of  the  point  from  the  light  source.  .  K,  C,  and  M  should  be  adjusted  to 
the  values  of  r  so  that  an  acceptable  range  of  numbers  is  fed  to  the 
display. 

2 

It  may  be  said  at  this  point  that  illumination  decreases  with  r 

2 

instead  of  r,  and  therefore  r  should  be  used.  Practically  speaking  the 
only  reason  that  distance  is  considered  at  al’  is  to  eliminate  the  pro¬ 
blem  of  the  parallel  planes  described  in  the  previous  scheme.  The  use 
2 

of  r  can  change  the  light  intensity  so  radically  over  a  short  distance 
that  the  resulting  pictures  look  unnatural.  In  fact,  depending  on  the 
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values  of  r,  the  use.  of  r'r  may  produce  better  results  than  r.  In  any 
event,  the  second  scheme  of  shading  produces  good  black  and  white  pic¬ 
tures  (see  Figure  5b). 

To  open  the  discussion  about  producing  color,  a  straightforward 

extension  of  the  above  will  be  considered.  For  each  of  the  additive 
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primary  colors  (red,  green,  and  blue)  a  shading  will  be  given. 


Thev  are: 


RiCos  ®! 

r  TC  +  M 


Here  s_,  s.,,  and  s„,  are  the  shading  functions  for  the  red,  green,  and 

«\  It  D 

blue  color  components  of  the  polygon.  The  values  of  R,  G,  and  B  define 
the  "color"  of  the  polygon.  What  this  means  will  now  be  explained. 

The  aspects  of  color  include  hue.  Intensity,  and  saturation.  By 
setting  the  values  of  R,  G,  and  B  the  three  aspects  of  color  may  be 
specified. 

The  saturation  of  a  color,  in  a  sense,  refers  to  the  pur it,  of  the 
color.  Pastel  colors  are  unsaturated,  brilliant  colors  are  more  saturated. 
The  control  of  saturation  with  the  formulas  consists  in  adding  or  sub¬ 
tracting  a  constant  to  or  from  each  of  the  three  values  R,  G,  and  B. 

Adding  a  constant  reduces  saturation  of  the  color.  Subtracting  a  constant 
increases  saturation.  The  maximum  saturation  under  these  circumstances 
occurs  when  one  or  more  of  R,  G,  and  B  has  the  value  zero. 

Hue  is  the  aspect  of  color  that  is  most  often  associated  with  the 
word  "color".  When  one  or  more  of  R,  G,  and  B  are  zero,  then  hue  is 
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determined  by  the  proportions  of  remaining  values.  If  red  and 
green  are  mixed  additively  then  yellow  results.  If  blue  and 
green  are  mixed  then  cyan  (sky  blue)  results.  If  red  and  blue  are 
mixed  then  magenta  (lavender)  results.  Variations  in  the  ratios 
of  these  mixtures  result  in  variations  in  hue. 

The  brightness  or  intensity  of  a  color  simply  refers  to  the 
amount  of  colored  light  present.  The  terms  "brightness"  and 
"saturation"  should  never  be  confused  since  a  color  may  be 
unsaturated  but  still  be  bright.  In  the  color  equations  given 
above  the  magnitudes  of  R,  G,  and  B,  in  a  sense,  control  bright¬ 
ness.  For  example,  if  R  and  G  have  the  value  1  and  B  equals 
0,  then  the  hue  of  yellow  results.  If  R  and  G  have  the  value 
10  and  B  equals  0  then  yellow  still  results  but  the  yellow  is 
ten  times  brighter. 

Brightness  is  probably  the  most  difficult  parameter  to 
judge  and  control.  The  problems  arise  due  to  the  way  idiomatic 
language  refers  to  color.  If  red,  yellow  and  blue  patches  of  color 
are  made  so  they  reflect  the  same  amount  of  light  then  disturbing 
results  occur.  The  red  patch  may  be  described  as  "Red."  If 
this  is  the  case  then  the  yellow  patch  will  be  described  as 
"muddy  brown"  and  the  blue  patch  as  "brilliant  blue."  The  terms 
"red,"  "yellow"  and  "blue,"  used  idiomatically,  refer  to  entirely 
different  brightness  ranges.  We  can  compensate  for  these 
differences  in  brightness  by  observing  the  percentages  of  reflectance 
from  some  "good"  colors.  If  we  do  tn:s  tor  "magenta,"  "red," 
"yellow,"  "green,"  "cyan,"  and  "blue,"  then  percentages  of 
reflectance  are  respectively:  20%,  20%,  70%,  15%,  20%,  and  5%. 
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The  worker  can  use  these  numbers  as  rough  guides  a«  to  how  he  should 
assign  values  to  R,  G,  and  B. 

From  the  above  it  might  be  expected  that  control  of  R, 

G,  and  B  will  give  complete  visual  control  of  color.  If,  however, 
color  pictures  of  objects  are  made  with  the  above  equations, 
the  results  obtained  are  disappointing.  The  pictures  appear  to 
have  been  made  in  black  and  white  with  each  area  painted  the 
appropriate  color.  The  colors  do  not  seem  to  be  part  of  the 
objects.  Instead  they  appear  to  be  masked  onto  the  two-dimensional 
picture,  (see  Figure  5c) 

These  disappointing  results  are  due  to  an  oversight  in 

constructing  our  formulas.  The  basic  problem  is  due  to  the  fact 

that  light  is  reflected  from  objects  in  two  ways.  One  component 

of  reflected  light  is  due  to  the  specular  properties  of  the 

objects.  This  light  is  not  spectrally  altered  when  reflected  but 

instead  has  the  same  color  properties  as  the  source.  The  second 

component  is  the  one  modified  by  the  color  of  the  object.  The 

functions  that  describe  these  components  are  generally  quite 

different.  The  following  three  functions,  although  not 

physically  sound,  yield  excellent  results. 

R  ;  Cos  v)jU  +  W  |  Cos  j!W 
SR  =  r  Vc 

G  ;  Cos  -|U  +  W  ,  Cos  |W 
SR  =  r  +  C 

P  Cos  o : u  +  W  Cos  '  w 


+  M 

+  M 

+  y. 


21 


•.  *  **NrVrv— n  m  S'4Kxa*sr‘-K-~  ►*■!%  **■>.* 


Here  R,  G,  B,  r,  0,  C  and  M  are  the  same  as  in  the  previous 
equations.  W  changes  the  intensity  of  specularly  reflected 
white  light.  The  variables  u  and  w  correspond  to  the  respective 
ways  0  affects  the  chromatic  and  specular  reflectance.  For 
example:  If  w  is  given  a  value  of  10,  then  the  specular  component 
consists  of  sharp  highlights  on  the  object.  This  gives  the 
illusion  that  the  surface  of  the  object  is  shiny.  If  smaller 
values  are  assigned  to  w,  then  a  dull  finish  is  approximated. 

The  role  of  u  is  somewhat  the  same  as  w  except  that  smell  values 
of  u  (1/2  to  l)  have  been  found  to  yield  good  results.  If 
pictures  are  made  with  these  formulas,  the  results  are  quite 
spectacular.  The  coloring  is  vivid  and  real  looking,  (see 
Figure  5d  and  compare  with  Figure  5c)  Although  this  is  the  case, 
modifications  will  be  made  to  improve  these  formulas  as  new 
aspects  of  lighting  and  coloring  become  important. 

This  discussion  has  been  included  because  the  literature  on 
color  emphasizes  analysis  rather  than  synthesis.  The  emphasis  of 
the  existing  literature  makes  it  hard  to  discover  wh3t  is 
important  in  constructing  a  shading  and  color  model.  In  any 
case  the  control  of  these  shading  functions  associated  with  each 
polygon  allows  the  user  to  achieve  a  very  rich  assortment  of 
lighting  and  reflectance  qualities.  Objects  can  bo  made  to 
appear  metallic  and  glossy,  thev  can  be  brilliantly  colored, 
or  be  of  a  very  subtle  hue.  These  capabilities  combine  to 
give  the  graphics  user  a  latitude  and  ireedom  that  be  has  not 
previously  had  in  his  ability  to  visually  represent  data. 
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CONCLUSION 

This  paper  has  dealt  with  some  of  the  basic  problems 
that  arise  in  producing  two-dimensional  halftone  images  of  objects 
described  in  three-space.  Some  new  attitudes  and  techniques 
have  been  discussed.  With  these  attitudes  and  techniques  as  a 
basis,  it  is  natural  to  ask:  What  extensions  to  this  kind  of 
graphics  are  possible?  Following  is  a  list  of  potential 
extensions:  The  extension  of  the  input  to  include  curved  surfaces 
as  well  as  planar  polygons;  the  inclusion  of  lines  and  text  in 
the  sane  inage  as  halftone  shading:  the  ability  to  specify 

transparency  and  translucency  of  objects  as  well  as  reflectivity; 

/ 

the  ability  to  specify  multiple  light  sources  of  various  locations, 
intensities  and  colors;  the  ability  to  specify  the  filtering 
qualities  of  an  atmosphere  in  order  to  simulate  fog  and  haxe. 

Each  of  these  topics  provide  a  research  area  in  which  no 
extensive  work  has  been  done. 

1  feel  strongly  that  this  enhancenent  of  visual  communication 
between  machine  and  man  will  yield  great  advances  in  .he  effective 
utilization  of  computers.  Data  which  once  was  represented  as  a 
sea  of  printed  numbers  can  be  represented  as  revealing  visual 
patterns.  Highly  complex  abstract  relationships  can  be  under¬ 
stood  at  a  glance  by  their  reduction  to  visual  relationships. 

(See  Figure  6)  The  development  and  perfection  of  this  computation 
tool  will  allow  man  to  more  easily  and  effectively  understand 
and  solve  the  problems  that  confront  him. 
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Fig.  5 


These  figures  are  representative  of  various  kinds  of  shading 
rules,  (a)  displays  only  those  points  in  the  display  file.  This 
method  yields  a  line  drawing,  (b >  uses  the  display  file  along 
with  shading  functions  associated  with  each  polygon,  (c)  is  a 
color  representation  that  uses  shading  functions  associated 
with  each  additive  primary  color.  There  are  no  specular  com¬ 
ponents  in  this  oicture.  (d)  is  the  same  as  (c'l  except  that  spec¬ 
ular  components  have  been  added  to  increase  realism. 
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Fig.  6 


These  two  figures  represent  different  views  of  a  two-dimen¬ 
sional  surface  in  four-dimensional  space.  Here  variation  in 
hue  on  the  surface  represents  variation  in  the  fourth  variable. 
Red  indicates  high  values  and  green  indicates  low  values.  Or¬ 
ange,  yellow,  and  yellow- green  indicate  intermediate  values. 
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